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ABSIBACT 

This report describes and evaluates t^ie bilingual 
program of the Auxiliary Services for High Schools (ASHS) Program in 
the New York City Schools for the 1974-75 school year. In 1974^75 
there were 12 centers for this program distributed throughout all 
boroughs of New York City. Spanish was offered in nine of the 
programs^ French in two^ Greek in one, and Italian in one. The 
bilingual program provided for the development of increasing English 
skills through English as a Second language (ESI) instruction. Beyond 
the ESI instruction^ the bilingual program used the native or 
dominant language of the^ students to develop competencies in. areas of 
reading develcpment^ math^ science, social studies^ and sevejral other 
areas. Some students in Spanish were prepared for the General 
Education High School Equivalency Exam in English or Spanish 
versionfj. The jprograo emphasized bilingual guidance and counseling 
for both academic and vocational needs of students. About 1/397 
students were served by the bilingual program in the 1974-75 school 
year.— Among the major findings of the evaluation are the following: 
1) students for whom completed test results were analysed showed 
significant gains in reading scores^ 2) reading in native languages 
showed significant gains in each of the languages for which test 
results were completed, 3) achievement in mathematics among the 12 
centers showed significant differences with the exception of one 
school, and ^) for tiose students whose results were known^ over 80% 
of the students who took the high school equivalency examination 
passed. (Author/AH) 
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I. PROGRAM DESCRIPTION 

This is a report of the evaluation of the specific objectives 
of the bilingual program of the Auxiliary Services for High Schools 
(ASHS) of New York City Schools. The ASHS constitutes a parallel or 
axternative educational system in Nevi York City. It not only provides 
ror those students who were former dropouts, potential dropouts, but 
increasingly the bilingual program has accepted students who were not 
achieving at grade level in seconc7.ary schools and were bilingual or 
non-English speaking in their dominant language. 

Bilingual programs have developed in the regular high schools 
in New York City, but increasing flexibility was needed for those 
youth who may better be served in a non-traditional type of program. 
The bilingual program within Auxiliary Services for*iHigh Schools 
was established in 1972 in the Broax and in Manhattan, The Bilingual 
Program in Auxiliary Searvices was extended so that by 1974-75 there are 
a total of twelve centers prouiding English as a Second. Language (ESL) 
in a bilingual program. Of these there are four day centers: one in 
Brooklyn, two in Manhattan and one in the Bronx. There are eight evening 
Centers, one in Manhattan, one in the Broro* , two in Brooklyn and two 
in Queens and one on Staten Island. Spanish was offered in nine of 
the twelve centers and French in tvio centers. The program in Groek 
was held in Queens and one in Italian was held in Stated Island. 

The bilingual program provided for development of in- 




croasm^ B«,aish s.UI. In En^Tl.h a. a Second taneue^e. Be- 
--nd tho ESL howovox. t.. bU.,n,ua. p.o^va. used native or 
>o.inant 1..,,..,, to Cv.Iop 1 onoies in areas of reading 

ctovelop^ent, .ath. science, .ocio. studios, and oth.. areas 
So^e. students .„ Span... .... prepared for t.e aoner.l Education 

Hieh school .,ui.alonoy oxan En,,i,,. ^r Spanian versions. ' 
The progran, ea,p«,,, b.,.in,,ua.l ..uidanc. and oounselling for 
bcth academic and voccticnal needs of .tud.nts. 

The ge.,eval obJ.ct.xve. of a bilihfiual proera.„ within the 
-• ^iUary high .c.^ol . pro,.a. ... to ...v.^- about development 

Of competency m readl.^. spe.i.i.^, both native language 
English lan^ua.^. n:.a tho.a tic skills. m addition, it 

JGcu-'i to continue, tho ova-v-li ^ droa n,- ^f- . 

..a.. €.cuv.at,iO!i of youth through the 

c.viiinant languia.5e whctJior it iv> ,s: anJ 4 ^« o 

, anisti, .ifcolxan, Greek or French. 

The bilingual progran^ i. c..ar..ctori.od by change and 
-ve.ent. The stud.nt. .r. .nt.ri.^ throughout the year and 
^.Pletin, th. h.,. .,..v.lea.y at various examination ... 

y • - inn x .uix of the program 
".•.03 for son^a fluicU-.y .f .tu.iar.t body. Tnero are a core 
-,u.Xa:- .-ctendiP., students much less than- the official , 
irisfcer or onrollraent for tbs cla?:^, 

in.crd^r r,o p.....e an overview of the variation a^ong 
t.olva cont.., i„ ,,,, ^ ^^^.^^ description of 

— ct«ri.tic. Of e.<.h cen.o. .i.l folio.. No individual 
>^.-.:..ont. arc. n,ad. m .he.c roport. on .taff oo.nmi..,a„t and ' 
■.3...-.«tion, evaluator ha. fo.nd a ^enoral pav.tern of 
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high dedication and oo..it^evt tUr.UeThcut th. i.rogram. Staff 
work long hours on cv^ation of n*.t.ri.i. to c^^ry out instruotiona 
and eraluation of results, bilinguai program has a group 

Of Wghly dedicated t^achors orking to i»pl«„ant tho philo- 
sophy Of the program, r^e four c!ay o^snters ara presented first, 
follovod by the, oToninfe. o*ntors, Th« material ±n these des- 
oriptiona »as ba3»d..^on intoj^vieva with each center ataff and a 
review of witton reports, 

IHB <X>UI?T STREBT SCHOOL 

and it ^^vides lllttlJfT'' '^^g^ni.ed since 1973. 

in tho W Street CenJea 'ThST^/L''^""^"*'"^^^*^^^'' registered 
dance of 360 nr ^"^ average day atten- 

spani,2^doi'i„; liu::.:t^? '-'^^^"--^ ----- 

ty Incl^ls'lfreLX^i: ZoTl,Z:ZlLn street facili- 

with careful work^t^^ard ?ont?n?Jrd^tei«^''^;^ J"** plaooment 
language, eatb and otnl^ itoll It^^ mastery in the 

program includes a^cLduLd tosknri„"S"f^?^?; 
room with the ESL proszram £ol J ^^aoility in a separate 

adjacent area. P^'^S^^im for smll groups carried out in an 

bv a \J^ti!^^^ Street School program way bo characterized 

students are referred to -h?^ f^^^ . J ^i* student, 
and enter with 3o,«r„1isgi;JnL ?roouo^tfr'' Broolciyn 
orlentatim procedure is orTrKhiorSeek^ The counselling and 

getting acqiutintod- and of LcollL ^ period for 

program being orferoS!" ?aci?itv tif 

equipment used ,^ th ^^;earL'ia*^;.'^:/:?«ni:Ly?^ ''^'^ 



v^2: FORSYTH STREET DAY HIGH SCHOOL 

in twc ™ ^'<»rsyjh Day High School bogan in Norember of 1972 

e^panaed to 12 full time teachers and a regiatration of 5gi 
students with a daily attendanca of ^^21. Of theJi. si^ty stu- 
dents art, in the Spanish bilinfiual program, ^^^^^ 

the !^ special features of the Forsyth School i. 

the aohoal newspaper which ig written and printed by the students 

auif«JJ^ i' ^J^«^biline«al program, the Spanish program, ia 
hiS^ ?^ Classes and th^se who are working for the 

cimbi^:5r:i :rir'"r^ in spa„i.h. v.. program ;Sif.era 

a^te^^w" '^Lfjr"^?"'';** ""-^^^ ''''''^ i« sroup setting* with 
a cSI?!: J available for special kinds of tutorial work as 
a choice for the students. 

from ll^Lr^cJ^nif ^''^^S * clearing house for referrals 

llll iuiSi^^tuS««Ji ; guld«^"oe counsellor within the program 

wiii guide students to nearby Auxiliary Serrlce progra«s. e ni 

#3: NIKBTY TKIRD STREET SCHOOL - MANHATTAN 

, The bl-lingual program for Auxiliary Serrioea for Hiffh 
fS5^**^%iASHS) at the 93rd street Center began in February 

?Aese eVty** ^t^'n ^^^^ students bare feoeiireS /^rrlLl, 
oi these exgoty students were in the bilingual program lA 
this center two languages are offered. French and Spanish 
Tolll nZdl /^'J^-nt^ ^9 s;>anish stuSe„t^"'^^; 

total number of students registered for the center is 310. wii* 
an airerage daily attendance of 264. As of May 1975 89 of tJ^ 
trltTl: T""" fr^""***^ 92 of thesfg^ad^aJes 

sSH^^ar^rf:a%r:Si\"4^;:.""^^^-^*^ 

and gro^'apprfLh'' '?Srb??i'*" ^r^'^^'" includes both individualize 
and in Spanish 5ie J "^"^^ Program is provided in French 

«l.o - ^Panlsn. The support services include counselling 

a«,7!??^**^^"i' ^^11«K« preparatory, family cou„seru„t ie^ral 
assistance and health services as needed. legal 

Observations indicate that tha educational woffram anrf 

t^rprrgrrrin'jLrifth V^'' ''^^ ha?r?S?vt3^1i.ed 
physical ?aci?ity whrc^ ho»:/"fr''' '^f «^"<'^*i<'n«l goals, Kowerer. t 
ThJre is onrt a^uf i 000^;\!L* ? various programs is overcrowded 
ma feel V fi, nnn 1,000 square feot, in contrast to approxi- 

• ? f«ot among the other cen^';ers The flr^t 

^oo^ ^i^ '•''^^^ ^roa ^ith high ceilings anS dl?isi^s ff 
[n th^ r^f.f^'' ^^•^"P^ tho overcrowded conditions 

in this facility arc a n^ttor th^t should receive son e aSiJ^'n 
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BRONX 

*-v,- n J-^''^''^' ^'''^^ do«ignato,:5. to vnany .is an abandoned building- 
the Roberto 01e«onte Center .In iha Byonx carries out a bilingual 
program and ^ux±X±f,fy serrices. Thorv3 approximately 250 

Is"??? or"^7'/*^'"^*''^ t"1,r^'^'''^^"'' ATorago WADA attondanoe 

^i^ual^proJraS!'"'"*^^ ^paniBh bi- 

There ar<; -i:hXM\.o im.jor pvoMisKS of the Clamente btlin- 

fhf i^^^^""^?; ''"^ '^^"^-^^•^ ^« bilingual, second. 

! ♦u*'^!,"^^- i'^'*'^^-^^^ organijied along general education 
lines rather fcten 3i«p7 y in ';;«r,as t>f reading and math iu^ludine 

commitment to gu;laanc.e and. Andiriduali ai«« the program for 

A^'ii'S^"*' to counseling and education allows 

for a wide rango of indiridual dif f eronco^for those who may 
not pass the equtv^ilsncy as well as those going on to oolloge, 

45: BRANDE^S I5VENING BILINGUAL PHOGHAH 

^.^^'^ Branleis Hl/?ii School o-TsniHg program for Auxiliary 
f j^orw Spanish bilingual program with 

cfl '-^^--^^ bilinet.al program%.ifh a smaller 

2 L . r^ '^^:^ ^.ttendanoe, T.- . BJvund^i.^ orogi-an. has a 

^L'^*' 'S^neral education and atlranced r^reparation 
oourso wos-Jc includes veauMUal vork in reading 

eaUi^^an'S ''^^ "^^^^"'"'^ "^'^ ^^^^^ ^^''^^^'^^ high sShOof 

and coar«o« attenipt. tu oara for individual needs 

to lnd?^lSL?r^'-^'"^' a«idanco and counc^elling . in an atSemp? 
lori ft itT^^T ^ central. The bilingual course 

?h«^« ? ^P^'-^^f^ uso.; c^. ««:ldanco and c .rmsslltng approach! 

Ind aitl. l ("^SV^^f onsages the ..tudenta in tutoring 

ration work for stm>.^,VB v;ho ar-o cono«ntratine on building 
up areas of weajcna,..^ .,nd pur^uxr.. the hi^jh school equiraJSnov 

nre^?r T''"^"" who hAre fairerthl exa^* 

previously and are empha.ir.ing an area of weakness. !^err 
I J^I «*«d^»f;« ^±th r^ry little prior education who^re! 
oeive oounseAj.ing res£-rdinK th^ir prograo,. 

«f« BrandsJS.s .'JchooX .Hvening J'rofe-raro has another pattern 

of organization. Mondays and Jedhcsda?a thoy have hi«h ^schoSl 
aquiyaloncy prei^r^.tion . Thursday is- I day Lrindividual 

IoiLrsS?a'5.T'?'^'''^'"f'-°" ^"^^^ ^mpba^i,. on science and 
st.jdies ;?,nd Axvevaturc. Individualized reading and 

aidinrJndK?S^^°""r"''' "^^^^^^ 



.#6: RICHMAN HIGH SCHOOL 
MANHATTAN 

RicIiEnan High Sohoolr on tb& East Sxd^ in Manhattan, sorres 
a vide range ox" istacionti:. 5oj;^e of United Nations ©lopioyees* 

chlidren attend, in oi^clex to Iwam fingllsh in the ESL classes. 
The bilin^guai cId.ssos ^X'b di3^eo{ed toward the Spanish language 
students, but many otiior Ir^-nguage backgrcrmds are attending 
programs* 

The progrezc at Hicjbiiian pvoridos for a number of courses 
such as typing anu buoin^=»s^ jsicills; c.a wall as the regular 
bilingual program » Ttxftro aro ovr^r 50 students enrolled in 
the bilingual program. 



#7: TAFT HIGH SCHOOL 
BRONX 

The prop,3ras« at Taft High School in the Bronx is 
Spanii5h bilingual u^i<;h an effort to serve a range of individual 
differences in ability. Tub program hag developed a number 
of modules in tottoh±n§ an<i uses various levals in working with 
the students. Tho progra^j* has job develcprjpent and oounselirig 
services along with fhe ;;^£»galar bilingual prograra. 

There r:re 120 c-nroll^d and there arcj 70 in regular 
attendance, Th<-i m^ny Xov^^Is oC the progra^j and the need for 
some regula-i^ testings; pa^ *c^?.'n be ^a^ae apparent d^iring the year. 
The emphasis on counsel ins and inclividunlizing the program 
has been a main f^^afcux^e, 



;f8* PROSPKCT HEIGHT-; mm ^(MOOL 
BROOKLET*; 

Prospect Kei(4-iV:;:; School bv*£>an in July of 197^ with 
1,000 farget popul^'. cion ot utndovti bat^^oen the ages of 16 and 
21 who live, in Qts^Tord Stuy v^i^ant . .84? iytudents have been 
servad thus ft^r vvitl an i/ipcictation of serving 1,000 by 
June of 1975. The rvagistry is appro.^imately 260 with an 
average attendance of ISO, Th^ro are 37 French Bilingual students. 
The general poverty oT the Bedford Stuyvooant area is well 
known • There ar© many West Indians in the area, predominantly 
J?*ronoh speaking, Khil© in the Central Bedford Stuyvesant area 
there are na<:ive blaok Americans, 



This bilingual p.rograra Is .small part of . the evening 
program in the larger ao JTevb about the bilihgual 

i3 carried froo one studont to another,. Th<^ instructional pro- ' 
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gram is orgatii^Gd around Vie relupi:{v^t^^ concepts 
and skills for various levoJ.e^ ^-^ohi^^ement Obrough the use 
of SRA leai^ning Xaboira tory rr.ateriulr.. -J^nis' imlividualizes 
the program and provides a ciear ri of acoo;5oipli«hs»onts» 

#9: HAXWEUL KTENXNG GUXBANCIi: CSWTBR AUXILIARY SERVICES 
BROOKLTO 

lliere are eLpproj-cin^^ iioly 35G ^:;tudents veg:lstered in 
the Center with :i nightly a-jtondance of aroiuid 300, of which 
140 are in the bilingual pro^rem ir. Spanish. The classes 
offered include remedial reading, Bxiglissh, math, as well as 
courses in typing and the ui^e of business luachinos to aid 
in the deTelopment of employable tiktlls. The program ia 
conducted on an inx'ornial basis serving a wide range of 
abilities of young adi^Its vho attend^ The program is 
organifced so that a flov .^h-^et depicts; the initial referral 
and overall program, A counsvsllor wrks with a given student 
over a long period of timt^ in which ro£:ults of ijesting and 
of progress in vork are roriewed. The prograra is organised 
around ro»adiatton centers for tho.%e vho no^d it in oath and 

Cf^i ^ readir>^ and English as & s:^ocr?d language i^or developing 
Skills in thx : area. In addition cbe Center has services for 

n^L^^r^ ^^r''*/'"''^' '^^"^ elcill5 T^MUi^ to typim:. key punch 
operation, heaul;y culture and ox^^t vocational .reas. In 
terms of the high school oquivalenoy unit, altern«tti-ye 



#10: JAMAICA EYENIKG CBJt'TKS 

Jaraaioft Bv^^nin,-;^ oontor is iQcasQd in th«> o.ld Jassaioa 
Vocational High Schools Thc^ro currently 290 students 

with an average n tterKJAnoe of 200 , of y.hi --^h 50. a^e -in th« 
bilingual prcsrasi, Thajro aro 2 bilittgua.! teachors who speoialize 
in raading ancX math. The I'.coticn the Jamaioa orogram in 
the Center &t (iMa^ns dravfs its cliwatjj .from Tai'ious areas of 
the borough. Thg program riais froai 5:30 to Sj30 P.M., Monday 
through Tliursdaj' I2 months of *:he year. In addition to the 
regular auxiliary program, ooansoliitig ^ testing and basic, 
education, rareod^afcion, typin.g:, high sohooi €)quiv&3-©noy , tho 
bilingual Spanish program xs offerad v;ith high school equivalency 
preparation. for two eronines Spanl sh instruotion and tvo OTenings 

rrnf"?i^ t"" t "''"T'f ^""^''^^'g<-^ -^^^ 3i-'^en; 120 «ere expected to graduat< 
trom the school ox which my ny arc from the bilingual program; 
about half , 62 of fho graduates hava bean adinittsd to college. 
Twenty -Seven enrolXod are -/stwrans. 
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#11 JUNIOR HIGH #10 

auaruftr of if??'.'^ cirorf;s .^ore njado to build the 
^o!! ^i""/''^.'' bilineaal pro£rram to serve, the laree Greek 

i" C'*"^'" ""'^■'•■"^'^ 3:n thecal! of 

thl J. program began vith ^iv cnrollees looking forward to 
sohon^^ T ^i'^ learning g„^;ii.,h. Since therf is no high 

»!?niT?.''''"^ in Greek, the .tuden^s soon e.xpressed ^ 
tneir priorities on tne valtae of learning moro English. 

The stafr has found thai: as i^art of a new Dro^ram < <• 

S:teS:i"s f^r'^'^T''^'^'^^ searching for app^^^rSJf hiliJgual 
^teJlai! and constructing their cnw projects to develop ^ 
materials. The cultural bias against the types of tests used 

Sh:ir?derofT%r"'^^*r"" ^^'^ of'^^he sLd^^i'to X 

e«^iniM ^^^^^"'5 Thsro are approximately 50 students 

enrolled with new students entering throughout the year. 

non r-iZT^^'^^^'''^.^''''''^^ English in reading fiction and 

non-fiction. The basic skills of arithmetic and general 

:iir:%r!r:,::n,;jr\t;h!'" - -oiai Ladies 

tutorial z:^^^rT^^^ 

sS^PRSJ^f '"'^'''^''^ "^^"^ BILINGUAL AWilLlARY HIGH 
'•^ i STAT-JN ISLAND ^' 

In February of 197/^ r.ha Auxiliary S^arvioe Bilinirual 
prograja for high soho.l. intrcducod XtalLn-Enilisb coCfses 
for iSfr^ Colloge. This program wa.. originally des^gnel 
for Italian students who h^ad limif.ed background in English - 
Tlxe progran. runs frcm J>?onday through Ti-.uraday English.--- 

307 stulUT ita^^^ Staten Island there are 

^0 t-n^n " J.'*'''*^''^^ «»iglitly attendance with approximatelv 

50 to 60 in the bilingual Italian, The Italian oroeraffl ha« ' ^ 

:nr:2il1i"^"*|.r,:\r — ^clerehle range' oJ^prLT^^cftron • 
«4«a!f r '^^ "'^ ^^^^ school equlyalenoy exa- 

English. In this prograra ths staff has spent considerable 

time aear Chi ng for and deroloping project .naterials that 

are appropriate for Italian bilingual programs for high schools 
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II. EVALUATION OBJEGTIVKS ^.J?D PROCSDURES 

Tnis section of t\ describe the evaluation 

objectives, the «valuacio,» .nts used, the sample aXze 

and types of evaluation procoduros used, and the time schedule. 

The evaluation objjeotives are parallel to the px^ogram 
objeotivaa and listed in the evaluation design developed by 
the Office of Educational Evaluation of the Board of Education. 
They were as follows: 

Objective | 1. 

As a result of participation in the Bilingual Prog.raia, 
the reading grade of the participant will show a statistical] y 
significant difference between the rvnal post-test score and the 
anticipated . post-test score. 

Objective #2 . 

As a -result of participation in tho Bilingual Program, 
the reading level of the participant in the Spanish, Italian, 
Greek or yrenoh language will show a atatiatioally significant 
difference between the pro-test score and the post test score. 

Objective #3 . 

Aa a result of participation in tho Bilingual Program, 
the mathematics grade of the participant will show a statistically 
significant difference between the pre-rating and the post-rating. 
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Objeotive -^U . 

As a Tosnlt of r>ar1;icipabion in tho Bilingual Program 
students viiil shorn a Qvatx&xi.c!aiy ssionificam- difference between 
pre-teat ratirjg and post-teat rating in thcit ability to speak English. 

Objective f5 . 

As tho xQsuIc of participation in the Bilingual Program, 
at least 80 percent -aS^ the students enrolled in the bilingual 
preparation coitiponont for the hi^h school equivalency examination 
(Spanish langimgo foroi), will oaaa the High School Equivalency 
Examination in Spanish. 

Objootive f6 . 

To a5Bf<:33 the discrepancy b^tw&on the prograta as 
described in tho proposal F^nd th«i prpsrara planned and actually 
carried ou V. in the iinplewcnfcat .".oa- . 



Eval ua tie n Xn s txntrafmjb^ 

'iho ir.utriiments us<3d in study include formal 

standardi7,ed Ijjs; -.tvmnonts and project developed instruments. 
For Objeotiro -IL fcho asaoasmont uf English language reading 
was obtained by using the Mili^f^I^Tli^tan Achig vetoent Test Form 
H. For Objective: p i\ nuniber of different instruments were 
used for each rai?pocti/e Inngua^re to ndsi\r,ts tho increase in 
oompetonco in tho student's respco^b.". re native language. For 
Spani?;h •'..he InfcorAnKJilcctn Roodin^.!: T^j.it (?rouobtt de Lobtura ) 
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by Guidance Testing Assoclai^a.^s ^vas u«ed., ptrfcs I and II on 
reading and vocabulary L'^vol 3, ^^ortaa, CBS and L]) DBS were 
used in pro- and post- tests, J or French, the Solenoa Re- 
search Assoclatefi^ ^^aba rr toijx^^ l-^^'^J^^^ vas used for 
pre- and post- testiln- This is a complete reading kit with 
pre-test and place nstx^ucti^onal materials. The 
grade equivalent conv. . tn are established through coBununicati 
vith SRA, For the Greek px-ogram pro,ieot developed tests were 
used since standardix^d tests are not available. The material 
used was adapted from (^r<^ok tests and textbooks. There is 
no claim to the reliability of fchi^ instrument used in pre and 
post testing, For tho Italian Prograin a number of testj were 
developed. The pre- and post- tests relied upon Italian 
examinations in Ne?^ York State Regents Exaaaina *;ion for High 
School from previous years , Again, due to the lack of stan- 
dardized instruments, the project staff developed these 
instruments. No olaiui is mado for the reliability, 

for ObjootiTo ^^^3 the .Ncjw York Arithmetic Computation 
Test JTorra D was used^ Thi.rv ics a b^^sio tool uf?ed for grade 
7-12 mixed fundanenfel aritiwotlc skills o used by the Board 
of Bduoation. Different vex^sionsr. for pre- and post- test 
viere used, 

yor Objeotlvf> ftk , tht^ assessment of the speaking and 
understanding Bn^Misii imcs made, usliiig: the New York City Board 
of Education's "Rating Senium of Pupils Ability to Speak 
English** on a pro- ax;d post-- ba/jiw. The maximum score is 



iiji and the rau^'-n^:; nUMxe oy tt^o itir-xchor , oa student use of iingiish 
vocabulary, structure^ pronunciation and intonation* This 
measure produces ordirjai dat^j.. The pre-test ratings were 
made in lino with the Oonsent Dsor^e und so post-test used 
the same Instrumont. Sine© that titno the Coa£?ont Decree 
English Language Asse.ssment Instrmnent (v^BIiLAI) has been 
developed and could be an ji1 torna ti voj in the future,. 

Size of the bilingua l J^r^ogranj and the Sa^^^^ of Stude nts Tested 

There have boon l,j97 students served by the bilingual 
program in the 197k - 75 school year. Of those many have com- 
pleted the prcwsram, sono pa^.sed Vho high sohool equivalency, 
Some were diachnrgod duQ to lack of citteudance in order to 
make room for other students and some hove <intered the pro- 
gram recently. Of the 1,397. nearly 1,13^ are Spanistr., 113 
are Frond , 90 aro Xta s^^ar. ?nd 60 are Grae.v. Partial test 
results werTj obtained ' ro*r 997 :;<t.uden^;s or o - 70% of all the 
students r the bilint^uol pro^rna?. 

The nuniber of studentii trho completed oacb respective 
test varied; many coinpj. ^^tod only «i pxe wG«t, buv hsd no poet sooro 
data could net bo included in the final sample for the analysis 
of that |>arhicular o-".: .iatJon objoct±ve>, IX-^ ttx was compiled 
by schools vith i\ tot,--.l oV overall comp:i.r:te sets of tost 

data for 1 schools. Th.- s^:?H completed ro-; ^onses for the 
entire U vy of tor.i , w-r :- mi\d^ up of at least 397 Spanish 
dominnnt 1 dents fro,r two cer>ttn-5; b3 Italian doinincxnt language 
students from one center; j6 Gr^^ok dominant language stu- 

dents from one coutv.r; and (>o ?rKn-ii doodnant language students 
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from two .centers . 'l^b)?../ ; follow shows a frequency 
distribution for each school. It shows tho average attendance 
in the bilingual proerum, the rumiber for \vhom some test 
results were recorded , and the nmnber who completed a battery 
of tests within each school. 

TABLE //■! 



SIZiS OF TEE. BIHiNGUAL PROGRAM 
AKi: SAMPLE OF RaSPOKSES" 



Schools 



Day Centers 

#1 COURT STREET 

#3 93rd STRKET 
CLEMHNTE 

Bvening Contc 
/i*5 BRANDfilS 

#6 RICIIMAN 

.?7 TAFT 

f/8 PROSPECT 

;f9 MAXVELL 

,flO JA^?AICA 

#11 JR. HI /fib 

,rl2 RICHJMOND - 



Bi lingual 

Attendance 
TJ() 

60 
81 

200 

i:io 



5? 



120 
HOC 

Jh 

60 
90 



Test Results^ 

36 
68 
90 
93 

105 

68 
138 

53 
1^5 . 

67 

59 



Number who 

Comple ted 

Series of Test 
-^7 

if 3 
80 
20 

40 

37 
20 

37 
1.40 

21 

36 



Kvlthods^an^^ included formal and informal 

methods of ttssessnent. ^ite viaits were luade to every Center. 
iJi^orvicu soRsiona meetings with Center adaiinistrator s , 

tetichers and studevw^,<r, veK-e held. 

The methods or jtafciaticai analysis used relied upon the 
correlative H'' Tinoe we had a pro/post test with the same 

*Xeat, roj?'!lt.< ntudRtits from v/arious cycles of the program 

through out thoycrfn «timc caaes are nrcnter than r^vemge attendance. 
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' group of studont/i. In attrition to the correlated t. test, the 
Wilcoxon Sign test was used Cov Uhe assassment of the changes 
in speai<ing English and language skills since the data was 
ordinal. Additional statistical teohniqijcs included the use 
of percentage coraparison for those who passed the high school 
equivalency froca the bilingual program. 

Time Sohedule 

The pre tests of the jatudants began in September of 
1974 and the post tests were givsu in May of 1975. Visits by 
the erraluator to the Center wore raado during the Spring semes- 
ter and distributed to rarioua c6.ntors and at different times. 
Some of the progi^ams b^gan in the Spring and therefore 
testing was held at that timo , Students may enter the program 
at any tim ? and thoroforo inta co pro-testing ' s oontinually 
being scheduled. 
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III. f IN DINGS 



This section will report on fcho findings by dascrlbing 
the program in operation und ttion the speolfie rindings for 
each respective evalu^ition objactivc for the program. 

There are sorae reports of chaos in public schools, but the 
operation of the bilinsual program among the 15> centera thr«ughoMt 
New York City has served to indicate that purposeful meaning- 
ful programs attract and hc?.d many students' in New Y<>rk City. 
In buildings that are old anddliiap^datad , in some of the 
poorer seotlsono of the city, students who haTra dropped 
out, or quit school, or aro nwwXy arrivalG to the United St*tes 
m'^ny have entered InHo the ASH5 program and the bilingual 
program. Although there is a turnover of students and not 
all who enroll continue or oocjplcte the high school equivalency ; 
many .ds>, xhe findings ahovod that th* instruction was 
organized around the basic skills required for high school 
students from high school jsubjects in both tho native or 
dominant language of the studont^ &s w«H aa in English, as 
stated in the proposal^ 

As noted earlier, complete fcost results were obtained 
from a sample of atudont?! that totaled S6k sets upon which the 
basic analysis of tho daca consists. The sSk coroplete sets 
were made up of 397 Spanish dominant students from nine centers, 
68 Tr»mes2x dominant studc«ots from two centers j 63 Italian 
dominKsxt language students from one ©enter; and 36 Greek dominant 
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• language students frou one Ck»nter, 
Evaluation Objeotivo£> of th^f» Bj. ling ual Proj^ram 

Ol^j ectiv e 1 As a r*^sulfc of pa r4icii>atlon in the Bilingual 
Program, the r&adxvg g.rB.4o c^r thoptirt3.oip»ints will show a 
statistically .-rignif leant d;\f f A>j^i5r^c<» iM^t^fOovi ' poat^tast 
scare and ttxe anciciix^tod pc^t-toiit jycor^, The assessment 
of tbls objective was mad.^ b^^ xelifc^nc<^ upon two typos of 
ttoasurw^y th© Motiop<^litp-.r! Aohiovonient Tost; in Heading 
ComprebLdnslon Foriii and the Ne^f York City Board of Education 
Ability to Spoak Engrltsh L^^-n^aa^o Assteasmewt Soal<&,* 

This section v.-lll ri<s:>ort on thc^ r^asults of the analysis 
of tho Metropolitan Achic^ %-iinont Ts*3t (Hat) using grade 
oquivaiont pro~te -^t ?t.i?d pdt'- tast from 58 students 

from four diff^rejit. Ceni-or*^;. As* shall bo ^ noted, the dlfferenoos 
vero significant and ?;h'3 .^bjecoivo vN.i^. attained for those 
students with ooQplf^tod t; - r result^!, ITti^j evaluation design 
called for the usa of tho ccirrolatcd **t'^ tftst in a real 
poat-test arrd anticipated .^c-r t^ tost design, Xn this dosign, 
the pre-tosi;: grade oquiralont; scnre u^aw weighted by combining 
months of prior ^^:iww>lXn^ arri Xi-^ngth of time in the program 
to produce *ho ant:lcipHtod poi^t-^tesfc score as a oontrol:^ with 
the »05 level of slgnii'lcanco u^ed a^; a crit<arion in the 
evaluation design. 

On tbe imi^lis o/: ovj-nni^/'cd ^acx*^ airipng all schools for 
the 58 ^tudent-^^ the^ fi^oan v-r^. -.te-;^*; so?>r^ was 5.Q356 and the 
mean post-t©-«t tioorr^fas 6 :'if56 r/i^li e. difforonco 1*783. 

*^ Comments on tho rr^su-^r; 't^ " the^lTr n<v^^ 

be reported to follov ?.m;;jar Objec:^i^e page 
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The difference befwoon atsmdard deriation^ was ^138- The 
"t" test value on the MAT for e^i s^^^-hoola was 9; 966 wliich is 
significant beyond \:li-<; .05 le^^-oX requiredl by the design. 

The flchooJ. by soha:^l r*3snlt^ indicate soc. ^mriatica. 
School #1 had a Talmv of :J.w5. Th^j r^aan pr©«test score 

vas 6,343 while the m^aji pci^t-test score ^ms 7^X43 with it dif- 
ference of .800, and thfi diff vrence of st^dard deriations was 
5.802* It should bci noted thJit fchare wera only seven pupils 
who completed the MAT in this school. School #3 reported 13 
students with completed test results on t£xe MAT. The mean 
pre-te^t score was 4,115 and the saean for the post test was 

5 . 892f/ with a dif f ereno ©-of 3 * 7 77^i — The differ enoe of staTTdaxNd 

deviations was •8757. Th^j ^'t" value was 7.32 which is sig- 
nifioant beyond the ,05 lovol required. 

One of tlio new pxograiai? , the Italian language program, 
utilised the MAT a© part of the intake and provided data on 
38 students with pre and pf?st test scores/ The mean pre-test 
score reported was 5-23 and mean pcst-teat score of 7*02 with 
a difference between mean^ of 1.79 pointa« The difference of 
standard deviations warj l.ZkS and standard error of 2.025. 
The "t^' valuo wa.? 8.85 ui\Ai 'J? dL^,-reAs of freedom which is 
significant boyond the ,0001 J^jvgI. 

Many more students in thn bilingual program took the 
MAT than are roportad iiare, hnt ns will be noted below under Discre- 
pancy An^ilysis ObjocMve /f6,i:h^ HAT did not se^esr to be an 
appropriate prcP-tost nstrumer.rt for the first testing of students 
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It was dcscided n ' tho MAT until r stttfje in the 

progress of students va. acne^d. S^or thft total of 58 students 
who took the for pre and past test, the results showed 

significant itnprovansent in reading comprehension in English. 
From the sample who wero tasted it was found that the students 
did doTelop significant ioprorement in English reading 
oomprehension. The objective vas attained. 

Objective f Z 

As a result of jparticipation in the Bilingual Program; 
the -reading revel -of -the iparticipS 

Greek or Trench language will show a statistically significant 
difference between the pre-test score and the post test score, 
in the respective language. 

The assessment of this objective was mac.:© by a number 
of steps in analysis. Overall results for aaoh respective 
language are based upon completed pre-post test scores for 397 
Spanish dominant students. 68 B^rench dominant language students, 
36 Greek dominant langauge students, and 63 Italian dominant 
language students. 
Span lah 

In regard to the Spanish Dominant Language students 
results were from 9 of tho 12 Centers for 169 students showed 
pre test mean score of ^p.53 and a post teat mean score of 
57.0k with a difference between menns of 7.51. The difference 
of standard deviations oquuls 1.922.. Hie overall "t" test 
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•for Spanish dominant students i^ua 5O.81 which is significant 
beyond the .05 level. 

The result,^ of analysis. £chooi by school, were as follows: 

TABLE if 2 

TESTS OP SIGNIFICANCE FOR l?£AOi:« IN SPANISH FOR EACH SCHDOL 



School N 
— m 0= — 


Pro Tost 
Mean 


Post Test 
Mean 












70.1.1 


75,^ 


5.33 


4 2'^ 


-".55 


#z 


^3 


72.00 - 


76.8lt 


4.83 


4.624 


-6.86 


#3 


^3 


32.34 


39.43 


7.08 


5.38 


-9.21 


#^ 


20 


70.35 


77.55 


7.20 


11.46 


-2,81 


#5 


40 


60.75 


67.93 


7.173 


5.528 


8.21 


#6 


37 


62.95 


67.86^- . 


4.92 


7.78 


3.85 


#7- 


20 


. 58.6 


65.85 


7,25 


5.03 


6,44 


#9 


li*0 


32.80 


41.54 


8.74 


6 , 58 


15.70 


#10 


21 


55.95 


70.14 




8,01 


8.12 



Results for th« Spanish dominant students showed that 
the students have significantly improved in their reading and 
comprehension of Spanish. Two forms (DBS, CES ) of the Inter- 

American Reading Tost, £riiebra_jie_L5^^ I Il.were 

used, l^ixe students showed consistent gains between the pre 

and post test. The results of the correlated "t" tost show 

significance beyond the .05 level stipulated in the evalliation 

design. 

The results for some 68 students whose dominant language 
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15 French oamo from two schools. In this caso the same teacher 
conducts classes In the day and evening program respectivWy. 
Central use vas made of the Prouch version of the Science 
Research Associates Laboratoire dos Leotures by Rene Serge 
Larouohe. It wa« usod for instruction, placement and pre and 
post testing of students; , Ttio language laboratory is cofioparabXe 
to the SRA Learning Skills Laboratory. The test is based upon 
a combination of speed, cofiiprehension and vooabiiilary , The reading 
laboratory outs across grade levels, but the color listing and 
steps may be related to grade equivalents biased upon number of 
words, and length of sentences » A set of grade equivalents 
was developed for each color section of the SRA Laboratoire 
Pes Lectures in consultation vfith the SRA publisher and the 
teacher of the course,* These ratings were used to code 
student test results in tei^ns of grade equivalents, A 
correlated ''f' was conducted using anticipated post-test scores 
in relation to actual post scores design^ 

The results were as follows: A total of 69 students* 
whose dominant language isS French mean pro-test score was 
6.101 while the mean post-^test score was 8. 81 grade equivalent 
indicating a 2.7 difference of means* The difference of stan- 
dard deviations ims .016 with a vary large "t" value of 
llkfiZ which is significant beyond th^ .0^ level. The results 
were similar for the two schools; the same inatructor taught both* 
In school #3, there ware 31 French dominant students » while in 
flchcol #8 there were 3? French dominant students reported. 

Hi 

See Appendix for SRA conversion bo Grade Equivalents, 



In school jf3 the mean pre-teist ^jcore was j)*j59 ^nd the 
post-test moan score was 8.7 gsrade equivalent vfith a difference 
between means of 3»X^» difference of standard deviations is 

1.17, The "t" value was 1.^8 with ^0 de^jrees of freodom which 
is significant bej-^ond the ,001 level. In school #8 the pre-test 
mean score was 6,53 and post test fiiean score was 8.87 with a 
difference between means of 2 « 35, a SD of .699 and a '*t" 
value of -2,0i* with 36 de^greew of freedom which is significant 
to the .OOCPL level. Therefore it is clear that tjhe French 
dominant language students tested shoved significant gain 
in reading in French and attained the objective. 
Greek 

/ 

In Septarittber of 197^?^* the bilingual prog-ram designed 

to serve the large Greek popalation in Queens began. Project 

development of ciirrioalum materials and assessment tools was 

neoesaary given tho x>aucity of resoux^^ces in Greek available^ 

The staff constructed px**oJe6t developed tests for Greek 

students y Using a variation of tho pre test in the post 

test for 36 students^ the pro test m<^Q,n score was 12*13 and post 

test mean score wajs l^^^S with a diiTfei^cnoe between moans of 

2, 67, SD of 3*77 and SE ,G2S; the correlated **t^^ value was 

4,24 with 35 df and significant beyond the ,001 level. This 

result showed support for cliangos in the reading comprehension 

in Greek for those who took both t^r^tSt however it should be 

noted that some of the students in the prograui did not take post 

tests. The Greek students, at- firsts reacted negatively to the 
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whoa* idea Of testing in terms >r meitipla choice questions 
.And time pressures, 
Italian 

In the spriiag of 19?5 in February, on the campua of " 
CUNY Richmond College, the ASHS bilingual Italian program 
began and enrolled over 90 students. Similar to the bi- 
lingual Greek program, the staff of the Italian program found 
few appropriate materials and tests for this special high scfiool 
program. Consequently, much of the curriculum and instructional 
materials J.e.rr-developed by the staff. Project developed 
tests included adaptation of tests in Italian. 

The pre test and post test used for this objective was 

a variation of NeurJ^>r^^ Examinati on in Italian for 

high school seniors used in previous years. 

There were complete test results for 63 students. The 

mean pre-test score was73.i?8 and n,ean post tas- soore was 83. 

with a difference between means of 9.^6 and SB of 5.67 with a 

standard error of .71^^. Using the correlated "t" the value 

was 13.24 with 62df which is significant beyond the .001 

level. 

In lino with those rosults it is clear that the students 
in the Italian bilingual program as tested showed significant 
gain in reading i„ Italian .bUe 1„ this program. Again it 
Should be noted that there was resistance to the formal testing 
procedures, ths multiple choice questions, the time pressure, 
etc.. but the staff found that it was possible to use a variety 
of tests as exercises and practice in test taking with the 



students who eventually became accustomod to t-jst taking 
"American style". 



Ob^jeot lve /3 

As a result of participation in the Bilingual Program, 
the mathematics grade of the participant will show a statis- 
tically significant difference between the pr ©-rating and the 
post-rating. 

The New York Aritharaatic Computation Skills test was 
used in alternative pre and post tost forms for the assessment 
of this objective. Results reported here are based upon com- 
pleted tests for 558 students in the Bilingual program. The 
overall pre test mean score was 6.2? grade equivalent with 
an overall post test mean score of 7.05 grade equivalent. The 
difference between overall means was 0.7759. The difference 
of standard deviations was .3763. The overall "tB value for 
math was 4.870, which is significant beyond the .05 level. 

The results of the students' achievement in mathematics 
by school are depicted in Table #3 bolow. 
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Tsblc # 3 



TESTS OF SIQNIFICA^C-^ FOR M/.XMEMAXICS FOR EACH SCHOOL 



Center 


■ E 

* 


Moan 
Pro-Test 
Grade 
Equiv. 


Post-Test 
drado 






If 4. It 
Value 






5.52 


5.70 


2.67 


1,84 


.75 


#2 


^3 


5.33 


6.20 


8.72 


1.76 


3*24* 


0 


80 


5.77 


6.53 


7,57 


1.^3 


4 71* 




. 20 


6.32 


7.16 


8.35 


.778 


4. 70* 




J(0 


6,12 


6.62 


.507 


.577 


5 56* 




33 


6.35 


6.88 


.536 


.072 


3 17* 




20 


5.85 


6.15 


.350 


.^12 




#8 


36 


6.98 


&,oh 


1.06 


1.00 


6. 29* 


#9 


137 


7.19 


8.17 


.969 


1.22 


9.31* 


#10 


21 




5.98 


.509 


.^37 


5.34* 


#11 


36 


6.06 


5,83 


.769 


.956 


4.83* 


#12 


59 


6.2 


7.61 


1,36 


1.17 


8.96* 



* Significant at .05 1q veTZTh^^di — 

The results of this analysis show clearly that only one 
school. (#1) had math test results that .ere not significant. 
While three schools (#2. 6.^7) had results that were significant 
near the .OO5 level of probability, and eight of the schools' 
results vere si/jnificant far beyond the .OOffi,ievel of 
probability. (#3. 4, 5. 8. 9. 10, 11, 12) , Therefore, it is 
possible to conclude that the students in the bilingual program 
have been attaining significant gains in matheu^atics as measured 
results were significant except in one school. 
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Obje ctive rjrk 

As a result of participation in the Bilingual Program 
students will shovi a statistically significant cJifference between 
pre«-te$t rati^ng and nost-test rating in the ability to speak English. 

The Sign test for ranked data was used for the analysis 
of the data froro 518 students for whom teachers completed 
pro- test ratine and post test rating; on the^ New York City- , , . > 
Board of Education Rating Scale of Pupils* Ability to Speak 
English. This teacher rating instrument was used since a 
pre-tt^st had been given at the beginning of the academic year 
in the yall oif 197^ or upon entry into the program. It has 
a maximum score of 25/ Each student was measured twice, pre 
and post test» upon entry and again in May of 1975. The 
evaluation objectiv itras to determxne if there viere significant diff- 
erenced gained in their ability to speak English. Findings 
shoved that 96 percent of the students gained while only 3*5 
percent ailbher remained the same or declined during the year. 

The evaluation- design called for a Sign test (Wilooab.n) 
and included the calculation of the difference scores between 
pre and post tests for tho 518 pairs. There were ten pairs that 
remained the same — showed no change — and are eliminated 
from further analysis. Eight showed loss or decline from 
pre to post test| some 500 students showed gain in rating on 
the Ability to Speak English Scale^ By taking into account 
the direction and the amount of changes, and then ranking tho 
differenoes by absolute size Of number from smallest to largest 
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the ranlGiiag of valuos from least change to largest change 
was carrLad!^ out. Rank values vrere added fxjr negative changea 
or loss and the rank dlf x'^erenc^^s fox posit£ifr?o ^ritesiges itare 
added ancL r ^^ts check*4 ii5 R Tfitbles fc^ Sigm Test:a to 

deteranime critical values , 

By .owing the same procodure for school, the 

Critical lU© for R was found for the number xf stuiten* 
each resp>ci^v6 school. In al] cases the oblt^ained R vas found 
to be less ;laan the Table 31 which showed tha - th:e diff#renoe 

^'I'OM Pi© to post test gain was signtfipant^ Therefore 

the objective to improve Ability to ^peak Bnglish was attained for 
^ significant number of students who were Tested, 

The School by school tally of the frequency of difference 
between pre and^post to^t rating an Ability to Speak Ejigllsh is 
depicted In Tabla # to iollow. 



W»J* Dixon and F.J, ^fassey, Int.-v due ^,^on to Statistical 

Analysif ?, K^sw York, KcGF£^'la"frrrT9F9 p. ^6^. 

P. tfilcovia^ Some Rapid .Appro^:^;. ito s tatistical Pro-- 
cedar o ; NY American Cyanamid'^CD Tl95¥T [ 
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Mfe^^JSNCY OF DXFrETlBNCE SCORES ST SCHOOL 
>^iSl ABILITY TO SPEAK EKOLISH EATING 
SCALE 

V 

(]Por Sign Vilooxon To«t) 



Coded Soboola, 



O 



c 

o 
o 



P4 



i 


^1. 








#5 


#6 


#7 


#8 




#10 














3 




i . 




1 


Z • 


2 


Q 


<• 


X 




♦2 










3 


6 






^5 




21 




P7 






? 








10 


2 


10 


11 


5 


• 

1 . 


3 


7<' 






t 




1 


8 


5 


3 


5 


>o 




•a 
«7 


12 


76 




1 


1. 
i» 






•J 

f 






3 
✓ 


20 




1- 




61 






9 




1 


3 


3 




3 


^ 22 


1 


1 


XX 


^0 


♦7 


1 


3 




I 


2 


1 


1 


2 


16 
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9 






1 
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I 




X 


3 


7 






5 
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6 
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2 
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2' 


8 


♦11 
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3 


? 
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413 
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1 








3 


4l^ 




1 




1 




1 














3 


♦15 
























1 


1 


4l6 


























1 


♦17 




1 


























W 




"1*1 


17 




3^ 


10 




■■ 119 


26" 




-■58 




CR 


7 




>L3: 


J* 




10 


1 


11 


^7 


7 


10 


18 





28 



yREQUBVCET OF NEOATIVB AND Tlfi SCOHBS BY I£J®}OL 
Ton ABIJJETY TO SPEAK EliGU'SH HAtlWa 5,.*X-SK 



Coded Schools 



#1 0 fk #5 #6 #7 #8 #S #1^ #11 #1^' 



Totals 



w» 03 0. 0 1 1 0 0 ;^ i 2 lo 

Scores 



Objaotlve #5 

As the result of partloipatlon in tba Bilingual ProQZ^mk^ 
at leAst 80 percent of the students enrolled in the bilingual 
preparation oomponent for the high school eq^^tiivaiency exattination 
(Spanish language form), will, pass the High School Eqtiival^noy 
Bxamination in Spanish* 

One of the objectives of the Bilingual Program is to 
proTide the knowledge and skills necessary to gain a high 
school diplo'ma for students. Iho high school equivaXem^ 
examination is available in an English form and in a Spanish 
form« 

The number of students who took the SpaniiBh Mttfi. school 
equivalency oxamination in school year of 197^-^7:5 frmii 4Jxe bilingu 
program whose results are known was .a total of 209. Of ttesey 
a total of 188 passed, or nStte tjy ^jgr c»»n t of those lii^ine 
results are knof«n at this writing* This is above the criteaam of 
eighty percent, so clearly the objective was attained* 

' 32 



The dijatrilJutlon of the result s 



schools nay be depicted In 



TABLE # c 

.g:^i3g2S ,0F HIGH scHoo: aauivAigfiaT 



Ceirt«! 



D&y Cjinteg? 

jW. C«uri Ssreot 

#2 Forayth 

#3 93rd Street 

. Clflimento 

s- ygmlajc Centers 

Richff&r 

^ Taf t 

#9 MaxKcll 
#10 Jaaaica 
^•n Jr.. High.^lO 
••3.2 GUHX Collega 



Nu»\>er who 
CisBipleted 
the Teat 



15 
13 

13 

17 

ii-9 
18 

33 
C 

55 
8 
0 



Fas8«d 



11 
13 
13 
17 

'+5 
18 

27 
0 

8 
0 
0 



73!« 
10056 
lOOSS 
10Q5« 

92% 
10QS6 

0 
87^ 

100?« 
0 
0 



In th« light of tbsse* eesulta it is clear that over BO paxcoat 
of those ^laelents from th» Bllings&l Progrsan who took the Kl^gh Sohool 
aiuivai«ne3r::E3csariiBB.tlon and Sor vteta rasults wejre avallAble^mt ±fae tlae 
of this :r9!gwrt*, Mor« results aia? eagwcted ia the near futaxw, SSiEfe 
it not antasdpated that thc; trend taf perferBsnce will chan^B, « lit is 
clear that th« students in the Bilingual prcgraw who havie taekon the 
ril^5h School Equivalency EKBjainatlon exceed the criterion «sta]ii3:Bhed 
for the evaluation o"bjoctlvt!, 
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"Jbe objective of tr^s*?. :^ the lii.gh .school oquiralency 
tos qgr^rr-rs-j amphasls for rian;^ of the students in the program. 
Bait th®re arisi somo students c aiay not be able to pass the 
ei:£amlr»ct;iioia iKxth repeated ferTfi.-rts> to whoa th© counselors may 
oTfer jncds ^^Lcxi^noe* Oth<^>r rSvudents who are French or Greek 
or ItaXisKr J2::xnci there is Ixzrtle prospect for them to take the 
. > v> M> . ^^^^^ • scb«aklL '^quiv^l'fen^oy^' exai:^^ 'tn'^' Tbttia' 'i^ri^ ^thelr^ ^native- • ^> • ^>"^ 

la^nguage, was hoped ths::^ the recently developed French 

version of high school equiv^dency d«»veloped by Bduoatlonal 
Testing Service and the Amer-ioan Council on Education vould 
b» espprti^ffod f cx the students x^hoa© dominant language is 
French. This d±d not happen, which means that the students 
In the Bilingual program naus^ prepare to take the equivalency 
exaDii:na tlon in either English or Spanish at the pzresent tine, 
or lir mmme csa^ses attempt to pass some college entranoe without 
a hij^ school equiiTalencj^ diploma. 

The studei2!St:s,whc > Italian, Trench or GsJteek must 

take ttl^ exaxnina^tson ic! B^;:rrli±sh. The ifnplicattto:n f or the 
pTmgsmmr±^- a pervasive cortcenti^ation upon ESh in and through 
*l^^i«5!5r±Jttas bili-rrgual islasssers in order to .*<iev<>lop English 
lajigg^iL^ fesovledfee tar tho stuaants. 



34 

O . ■ ■ 4 



To assess tho discrepan^v --«tv*,«„ -u,. 

^ae proposal e„nd p^^. a-sd and aci^ually o^Tried 
owt in the iiapleowntatiort. 

Iber* hare been «a„y ncocsplishmeats «f tho Bmingaai 

X* ha, xong bean pax-t of the rHe±o..,o of «any educati^onel ^ 
program, to olai. to provide an «^oin« con^n«ou« p«,^ra» 
-^th indivld«.lizad program, for each stud.„t, Bilingual 
rrograo. ha, not realized tha^e g^is for ^^ry ,t«d.nt. 
In i:t there are ««„y consi:stant ^forts to use cou^aeline 
along With instruction so to .ndi.ldual..e the actual 
oducational oh.ectives for .ach p«pix. .xth..^ ^ prac 

tice rariea fr«» cenW oen^ter. the approach is * «a*„ 
thrust Of the pr«gr.«, 

olasso, for «t»dan*s to atto«*^ to "x^arn E„^:^h . 

In terms cf cmmmeiL:±imr strud^ i-* 

-t-o^ simde. ts., tdi0 program, while it varies 

from center to uontBr 5r,« 

noentsr. this a central ingr^eajt of 

the progran,. on. «tuden* inte^iewed put it to th., 

^.valuator, 

help me iearn and ger«y dl«ln^ *° 
goals for .lor work Iftlr- aT; «^ ««t 

to colleger ,3 iiio^.drhL^^. ^^f'^ ^ ^'^^ 

Many of the oemwcrs d» set 4nHi-n^™=T 

set indinml program objeotsares. 

others do not. 
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Tho attempt to keep tub /-loor."? opezi has at timas led 
. to a great fluidity and a irs'.^ o C c -ar ooro of t^h1b:x- 
students. To bavo a .-jeif - ;:.,a:.ed prr.gr*-.x requires considerable 
technology of inatruction ..rhifih is 1;. itirig in most af the 
Bilingual pz>ogranas. what xnd3.-?:;.clmi3 i-ii- t-ion there is remains 
the result of the keen cil .lical judgii3«r:': and. professional 
dedication of tho teachers whc tx&-v^ scaisred the resources of 
materials for bilingual prggrasiS. This, however, is not a 
self -pa cod, graded learniisg program such as is found in the 
Science Research Associate Language Reading Labors torr- In 
other words, the currioiiluL. :hnd instructional nia.t€STi«3^s by 
and large are still lackir^^: la systansatic develofaTOist . 

In regard to the high scbaol jquiT«^lejncy -pqrognsEin, 
there are a number of target igrr ips .sol^ar serv^ ias 
Bilingual Program.. One grou;p is cl^:i^l^ after tfa*^^^ school 
equivalency diploiEa, but fir t tija t ±± xa;; availablie ixx£}y in 
English or SpaniJth,,. This sEsasss thar; tL« J.tai;ia» asad (Sreeks 
and French must concentrate ,. Snrv t.^c Sowever, -th^re -is 
a second part of this g.oup -^.-r, vn«y i^ypass the higii ws-hool 
equivalency diploma itselX and take -ij. ileg^ work if their 
own prior education is zS rc.n-J c-^l-fc.r -th^ -ftntetc 

. college on a 'special prDv:- .a... Xh. a..^^ bilingual itiwjsram 

serves as a college " prepartrtlo a f »r ih..-rs, and the ^asrrpose 
of the program is basiof-i V.l > i-.r- 'f. rr .Toir , . -i"^. 
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In addition to th« o\;<^'-y--yXl n,; th-.^ curriculum 

and iixstructional models ought to 1>3 oxaniined* One basic model 
that -nas given some revievi by the staff and th<:> director was 
found -in the English Series by Robert Lado et al #1 and #2 as 
vfell as some parts of level #3, It was found to have a basic 
sequence of content, with skill development and scope that could 
be applied to both Greek and Italian and vfas similar to the , , ^ 
curriculum in French* In this connection the Iowa Test for 
Educational Development (itED) was found to have some value for 
botii normative t<^sting ar«i diagnostic purposes. Further investiga- 
tioa by the staff committees ought to be encouraged. 

Of the nearly 1400 students served by the Bilingual program 
during the 1974-75 school year, some tests results were obtained 
£xom over 70 percent of the students. As noted earlier in many cases 
these results were haphazard and incomplat*?,. In one case out of 90 
names with partial resiO/ts only 39 i^ere completed in valid forrn^ 
The 564 complete sets of responses for the entire series of tests 
reflects many more students than 564, r\e^±Xy 997 partial .responses 
v<hich is over 70 percent of the 1400 served during the school year# 
Thi^^ gap may be reduced further by more organi^ied recording of tests, 
selection and 'scheduling procedure for standardized tests. This 
matter has been brought to the attention of the director of the 
program and steps to b^ing about changes have already been undertaken. 

One matter that is not clear is the ;9ctual "holding powejr'* 
of the Bilingual program. The overlap of data from the Bilingual 

*PsObert Lado, e t al English Series , N"YoF>.^.^ents Publisheij 1973^ 
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program students and tUose in the reyular Auxiliary Services for 
lixgh Schools program has become a matter of interpretation by the 
Center administrator • In some casei -v^arious students are in BSL, 
but not in the Bilingual program for various reasons. Therefor.e, 
the reporting on the overall progrnns may vary until program defini- 
tion is clarified among the Center administrators. 

The students in the Bilingual program have access to the 
series of special services for all Auxiliary Services for High 
School ^tudents^ these include (1) job placement and foUow-up; 
(3) vocational and educational counseling; (3) remedial aid in a 
arithmetic and English; (4) preparation for High School Equivalency 
Diploma (in English or Spanish); (5) typing and/or business subjects; a 
(6) college preparation and college assistance information^ 
Th^se services are provided in addition to the regular bilingual 
education. The Centers vary in the degree to which they carry out 
the above services^ Many of the Centers have bilingual counselors^ 
other centers do not. Some Centers have greater emphasis on typing 
and business subject than others* Fevi Centers have job developers 
on staff, and these services must be provided for a number of Centers. 
The current recession has made job placement especially difficult, but 
has provided a not ter reason for youth to gi^t a diploma and further their 
education. On the basis of the observations and information obtained 
by the ©valuator, the Bilingu&l program students has full access to 
the special services of the regular Auxiliary Services for High Schools^ 
Suggestions viere made by the evaluator that brochures and handouts be 
translated into the various languages served rather than only in 
English, These suggestions have been followed, 
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IV. SUMM-iRY 0£ MAJOR >-I]iDiK..;:S , CONCLUSIOxVS AND RECOMMENDATIONS 

The Bilingua3„ 2-rogri:>.^ of Auxilicjry SarTioos for High 
Schools has had a ye^ar expanrion und olhiange. The program 
has grown coasi<lorab ov^^r tho la^it fchro© years. In general « 
the results of th« 9%raluation showed t;htit the program did 
nchlevo the basio oyalmtdon ob joo ^^iTec? for the students who 
completed the re^:pect1.^/e t^t^sts. Ait^r presentation of 
«n overview of thu pr<.?g:tan:, this eacfcion vfill summarize the 
rasults briefly Ir r ach respective ^^valuation objective, and 
then dravf ini\^ en.-g ^r ^,nJ conoiiis: r^nii thiat 5U{3:ije5t recommendations • 

Th*-::: •b^i^.lT^^ '.vtinvi..r.t:" for the bilAngu:vl pi^og^am are dis- 
•:.ributed in all bc.rou^^jhc? of i^-;.- York City, with four day centers 
and eight ev&n±n;^ Cfcntoi."s^ Hi^nhattan h^ti t;wo Jay and two 
r.:.g:at cajitesrs ( Spaviish " no. x^r^^nch) whil«i Bi^^^oklyn has three 
d'jy centers (Spanish) t^no, on':^ n^^h.:; oont<5»r (French). The 
-E-/onx ha^ a cIti/ and a i.^i-]r;: p:rc^ w'i i^panicrhK Queens has 
two night prot'ia:«r, ;o.rtyyk anti Spani::;h). Otjo night program 
is on Sta toai Ii.,l'iir\J (Italian),. 

Tl'u> bilingual prv^/ro.;j ir> calj/ pnri\of th© responsibility 
"^of oach oante?.' adroinis i^rator fcr tr.e Aii>:ilia::-y Services for' 
High Schools. Fho ^.i ty^^^i^.^e '::oord:va;7 tor fv>A- t.he Bilingual 
?rog:am ASHS must relate to aj.I iveXv^ oenteri , the resources, 
the xeaohers, iho ad!^ini&-tra tor 3 . Ihartn^j the src.iool year 
in March of 1973 tbc^re was ry ohaij^re in tivi oity^flde coordinator 
of the Bilinigual Pro^ran. The corsdinator tm& asteed to become 



tix. Deputy to tho diract.. oC fa. .apartment or 
■ E<iuo«ti„„. coor^„.tor gradually tooic over th. 

r»po..l.luties, r^^s s.i« i„ tK. top produced .o», adjust- 
«.ent» in pr„era„ a„„„g ^ per.<,„„al. «,e „„„ coordinator 
>»s devalopod p„g,.„, directions, ft. expanded 

BiZtngual program oaXiad for a number of new procedor... 

T^e»e were de„a.o^«.. i„ x±.e with suggestion. «de fro« staff 
tlxe various center personnel and the avaiuator. The change 
in ad«.inistration c..tribated to sone of the unevenne.s of 
test administration .nd the reporting fro. the various 
-enters. Mew pr,™d»r.s have been instituted, for example, 
so that the col..cti„„ of post test data went „uch s,noother 
ttan did the collect Of p^e test data. The reporting 
re,uires.ents for ti» progran, call for a number of records 
to be maintained on an ongoing basis. These have been revised 
recently. At the auggestion of the avaiuator a f„r,^t for 
cards was establi^ed with essential testing data, entry, 
teokground date on oash student. 

gverall Oreani^atl on _of_the Twelve Center.^ 

Hie twelve centers in the bilingual progran, are or- 
eanixed around a tasic «odel. The staffing structure and 
ourrioulun, organisation, the testing and evaluation, and 
the instructional „cdes used within each respective center 
reflect .^ny considerations. These variations reflect not 
only the language, taught, but the staff, the sl.e of the 
progra., the state of program development and cyc.e, surrounding 
co.«.unlty, the context and the traa:itio„s and originating or 



beginning stages of tho respective proerama, tha facilities 
themselves, the availability of relevant curriculum bilingual 
materials and resources, instructional and evaluation aids 
for respective areas « Each of the centers, while carrying 
out the basic model of the program, reflect the influence 
of the above factors in the implaraentation of the model . 
program. 

Staff variation and experiences and skills in implemen- 
ting a given philosophy of education is evident from . center 
to center. In the case of newer programs, the staff concen- 
trated upon curriculum development. There weire relatively 
few relevant resources for curriculum in Italian abd Greek. 
The staff of the newer program, therefore, oonoontratod 
upon the basic forroutive ourriculwtn development concerns. 
The Italian projjrftiii began in J^ebruary developed curriculum 
materials during FaII •s'.wnost'.Jr to play far the opening 
of the new program in stsxton Island, Spring semester. The 
Greek program in Queens «t Junior Hi,i:h #10 staff began the 
currioulum devolopHMxit during tha cunmior, 137^, It launched 
the program for studoncs in thw^ ?ail, 197^?-. In both oases 
these newer progrfnv.,!j are focuaod around curriculum development 
securing instructional natorlals appropriate for the range 
of students. 

French la provi.dt^d In M«nht\ttan and in Brooklyn, 93rd 
Stroftt and Prospect Hoigbts, but hero again there are relative 
f«w ftvttilablo ourriouluRi inntoriniu. As in the op-os of Greek, 
ItAllan, and Kronoh, the teaohors h«v<» to soar oh out and 
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develop and dovise many teacher tijade materials. The teachers 
work constantly on translation and adapting other materials 
for foreign texts for use in, tha i>rogram. In Spanish, while 
there are materials, to. .select, from, many more resources are 
needed. There are still many Qips ootvfeBn what is expected 
and that which is available on tho coiamorcia] market. 



Summary o f Major F indings of the E valuation Objectives 
Objective #1 . 

Tlae students for whom coi«x>.letad results t^ero analysed 
did show significant eaXvi in their reading scores « However, 
as it was noted, the use of the Metropolitan Reading Test 
was not used except for a fow of tho participants. As reported 
in the PindingSt the reason was that it: xvas considered too 
difficult and produced a negative reaction among the students • 
There are oth^r ti^sts such as tho California Achievement Test 
that have more diagnostic value, as well as having norms based 
upon large cities. In the absence of pre - post test measures 
for the other participant?j of tho program, one is left not 
knowing how much they have improved in the reading of English. 
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Ob jective fZ . 

Reading in native Ittnguaees did show dignifioant gain 
In eaoh of the languages for whom test results were completed* 
The tests used have certain limiT;a cions * The test© for 
Spanish, while standardized and videly used, lack basic norms 
to enable grade equivalents to be used. The test used for the 
French language has the advantage of being linked directly 
with the language reading development laboratory in French. 
This .7 directly links ^evaluation to instructional tools. 
However, we do not know as such the meaning of the post test 
except as a gain. Another independent test would augment 
the measure. Ttie tests for areok and Italian were project 
developed teacher constructed tosts. The reliability of 

these instruments cannot bo indicated until further refinement 
is made. Regardless of the limitations of the various tests, 
the results showed there were gains tliat were significant 
statistically and the 'objective was realized. 



l^b oratoir e do JLo oturo b> Reno Sovqo J;arouoho , Science 
^Br«s6^k^oh AsSooiaT^ors;*" 



Objective #3 » . . 

Achleyement In niathe0i& ^los among the 12 centers show 
significant difference with the exception of one school. The 
gain for students in basic math skills vas assessed on an 
irregular basis; however, among the various centers ♦ Qftie ir»ir|^#ti 
in the use of parts of test:: by teachers, and addW^^ 
to the standardized tasta^ reflect some mi sunder stahdittlr of 
the iMturo of normative based testing and confused the initial 
atiem]iis at data analysis. The administrator of the program 
is clear about the. testing requirements and has provided 
clear guides to the staff of the center for the future « 
Nonetheless the results of student achievement in basic 
skills in math are encouraging and the objective may be 
regarded in general as achieved. 

Objective 

The results of the language assessment rating by 
teachers of student ability to speak English show significant 
improvement in terms of the rating scale. Many of the students 
began at the lower levels of the rating with little or no 
English and have acquired more skills in speaking and under<- 
standing Snglish, however it is clear that iho bulk of the ' 
students in the program still have net mastered the skills 
of speaking finglish. While there has been progress that is 
significant there is more development needed* The racing 



scale itself has boen the subj^^ot of severe oritloism and 
resistance on the pax-t of fceaohers and others/ This rating 
scale relies upon teacher^i* judf^omcsnt and is highly subjeotlve 
and general in its catogories. As notod earlier in the 
report, the Board of Education has recently dereloped a new 
battery of testis ttiat will no doubt be used in the future^ 

Objeotive |f 5. 

For tho£?o student Kliose r€J55uits are known, over 80 
percent of the stuclonts v1k> took th^ high school equivalency 
examination passed* T>ie high school equivalency as stated 
above is available in Eu^rli ^h and ia Spanish. A French 
version of the GED a^s b o i pr0par*^d but its use is not 
authorized in iMew York Stv^io at tMs time. The criterion 
of 80 percent for t^iti?^ objc»otive vas e:xceeded since 90 percent^' 
of the youth have ivaK^cJ, Tho present r^iporting system for 
-;he results of fch*^ hi^^h ; chocr] eqv : v:v ncy oiado securing data 
rather diffiouit. The? 1 ig ^ s-choo ? f^quivalenoy Is^ one major 
coal for many of tbe .*:5-^udo -U5 in profirajw , but since It 
Acs not avai:i.-.bl ,o -xn Ov<:-L>fv:, 'Ltali'M' n^yr Vrcnch at tihis time. 
• these programr> Ua ^-c oi \iM;&^3xby oonc%>rned themselves with 
^:h 0 1 ea r ni ng o f : ; x\ ti 1 ^ U , 
Future of Bilin cui^ JJd ir on V. 1 on 

Tills prot^rtiiH dotriiu vos oontlut-^a tion. It has expanded* 
This has been u yoar vr.^ i, \nr c}inn^?i::>.a nnd with current 
budget restruintfi ih>.y v)rof:;raji\ ^jro / bo nndt'^r pressure. It 
in a program thr\t not only isinx^i^K iMruy bilineual potential 
real dvop^ouf.Sj, ur,t \ ■>o ui^o c^'^w thxis country. 
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One closing caveat;, in innovativ© prograsoft l:lk<j this Bilingual 
• program, the new PTOQv&i»s require froni teaohork tromotKlous 
oommitment of time and e-nftrgy ta and build it and 

sustain it. Administrators should be uwara at tbo denjands 
upon the tiino of toAohtrts in tranarAtiuf; v^^toriale, building 
instructional iaateriol& an^i othor ^ters ,. Tiier^j is a ten- 
dency for innovativo progxnrnst «>r this cyp* to bwrn up th© 
onorgids of staff affcc- thitto years » 

It is reconuBonclod that fchc Biliriguci PrograRi kaop a 
low profii.© with. ,its nov proffvams until th.9 oua^rioulum and 
instructional -is doveiopod. R^aianca av,on aadia for pr0grai3a 
attracts many and builda up hopes, K^^oXt^ u progfam of 
high quality with a core oj:^ studoVjts ijoing roquiros. tJi© full 
energies of staff. The promi-ioa of fciliiigual progsatamarar 
radio, toleirlision and through churchcvjs hEiP"© boon found to bo 
offeotive, but loss so than th. counselor .•a anc the word of 
mouth of e^aduatec. K«cb confcer should continue to Maintain 
its waiting lists, and foXlsw up on thos students who start, 
then discontinue, mny »>f the students x*oro not in regular 
attendanoo, yot tbt^ pr<>f;raK hny to tfm^ over a ichousand youths 
during the school yaar. 

The staff roquii far the Bilingua.', Progvoin for Aiixilia; 
Servioes must much'roc.r^, th<.n i>K>.v>*/jy iJiliK^fjiiii. Xho philosoph: 
of the program oulls, for t<^,•^o?u•,-^tt wh-> h*iVo qualifications simlliaj 
to the middle gj^ade cerctlf,i,.r..v.ion. Thcs*. .iuclud^ mure than bilingual, i 
knowledge of the mUx^e oultoo, "tochniqu.?.'. of teaching, that take into 
account ranr,e of indiuidual d:lif^>r«nce5. v..;c.:h apscial attention to noo<k 
retnodlation. At ;\ time of hua<j(:^% crf.HXs, it would ba n gnxwi 
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\ mistake to shif t orthodox foroJgn language tea chers into 

\ 

this progx-am ^^itlioot rogox^d to tixc philosophy ♦ Such action 
<5ould be counter productive . 
stingy 

The whole arof/. of formal testing within the Bilingual 
Pjj-ogram noeds to be .i t ^.ngthonod avid more understanding of 
its functions and its liii i Nations is necessary. Some progress 
ha.s been njade, 

I The pro test :t.;= establxi-h a baso-iina, not to 
nttoiapt -to bocoiiie a cc i-riihensive diagnostic and placement 
^:>oa. The hapliaaurd • ram in tho Bilingual Program . at 
presesstt and in ftbcj ,- i....-; ht?er. f.han£;.uv5 to a more organized 
iifcructure. further a L - . n ■ -: cn a!i.w..,;d be ^^ven to defining 
roles and rospoi^sibii;,. fci c s for fc«at;.Vn«, recording results, 
5-ranswittin« rftou?.ts, Jt :• rs c :.ri. ntind^d that a committee be 
jstablisnec f^jr a yvv'. ov t.>„ to i.'ii>J.ti ^iver; languages and 
a, determination of . t3 i bo u'-oJ and nn overall achool 
yoar schedule >:.e f o nnu i a t.3d. fhi^ committee ought to include 
rasouroes f>'o,tt tlio Of .n ro of nilia^;? j.>l H-:! no.a tion and perhaps 
from the locaj. iini-\H»-r.s;. iiv.-, Uachars ijocds for diag- 

nostic inforroa tio'i ma;. t:iot by other terms of testing. 
Tea oho r c»d.:. t^sts ax-o ir-.-va.nt to the «urrio 'Juw, but their 
reliability .U, vtvi y lov,. , Pro iuot .iovolopod tests require 
careful develOiYm-nt , niuUy.vij. uad rc'vision. The instruments 
in many itistanoo^ tiiis ytu^x- wpr« cituit: attempts at assosftm«nt. 
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It is recommended that the Bilingual Progxam establish 
a city wide curriculum, instruction and testing committee. 
As noted earlier such a cotamittee •.:ould rev/iew a number of matters 
that currently produce sonif* confusion. Sotae olaarific^tiatt may be ac- 
complishfiGrd without a conmi*:ta, but staff implementation is necessary* 
The fact that the High Schcoi Equivalency is a;ailable in Spanish 
and English has implications for the emphasis upon English in the 
French, Grsek and Italian prrograms* The bilingual program does 
not raeasL just teaching in a foreign languagel The Bilingual 
program.-xe2!ies .upon its st^rSf to bring English into every area, 
and yet :to recognize the spacial contribution of the ESL teachers; 
this matter is not always clear* The entire staff function to 
provide some counseling services, but bilingual counseling* ajfe not 
available in all Centers* This is due to staffing limits. 

A final recomo^^ndr^ V:.r>a is thnt rbe entire Bilingual and 
Auxiliary Services Progrrm bo vie^^ied in systems terms and a series 
of flow charts and visvioX di.x>lays b<? c:^veloiv?cU Prom sucn an analysis 
not only wall charts for ctach Center, but brochures and booklets 
for students could ho fU^voIcped xnid used during orientation, intakes 
and duating conforcnccy: :>r) progro^^s* Many o:f thf.? conferences vfith 
students ^ssentictLly re[>t;.;>::.^ ^he st-^.i^e inirarraaraon* The display charts 
could depict intake, icegistration, intervievis, testing, pre-tests, 
placement, guidanc^rs oL^-sfJos and lovols, assessment, job placement, 
remedial aid, tntorl'^l -.cr^/jcMS^, post tOsM^iing, high school equivalency 
information, and other 5.jrvicai5« 
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SCIENCE RESEARCH ASSOCIATES 
LABORATORIE D£ t£CTUR£ 
GRADE EQUIVALENTS FOR SIX LEVELS 
The Laborato rie de Lecture of Science Research Aisaociates 
is a French language fcading development series. The k3r*3s designed 
for grades 7 - 10. In consultation with the publisher, ztua- teacher 
and the ewaluator established the following criteria for grade 
equivalent ratings: (1> The number of words in the comprehension 
and power or rate sections; (2) The number of words per sentence; 
(3) The types of questions asked. A review of each of the six 
color coded sections or levels indicated the following |prac(e 
equivalent ratings that wese used in the analL^tsis of test results. 

Violet — — 9.0-10.0 garadfe ftquiwaleret a sections 

Rose- — — 8.0-8*% grade equivalent 16 sectiasos 

Blue- ——— 7.0 grade eqmva lent 16 sections 

Green-— — — 6.0 grade equivalent 16 sections 

Yellow- 5.0 grade equivalent 8 sections 

Red-— — — 3.5-4.0 grade equivalent 8 sections 
The pre and post test ratings in teras of grade equivalents 
were made in litx> with the above scales. In this way both the 
color and section were used in the determination of grade equivalent. 
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